Sentence Modeling with Gated Recursive Neural Network
نویسندگان
چکیده
Recently, neural network based sentence modeling methods have achieved great progress. Among these methods, the recursive neural networks (RecNNs) can effectively model the combination of the words in sentence. However, RecNNs need a given external topological structure, like syntactic tree. In this paper, we propose a gated recursive neural network (GRNN) to model sentences, which employs a full binary tree (FBT) structure to control the combinations in recursive structure. By introducing two kinds of gates, our model can better model the complicated combinations of features. Experiments on three text classification datasets show the effectiveness of our model.
منابع مشابه
Segment-Level Sequence Modeling using Gated Recursive Semi-Markov Conditional Random Fields
Most of the sequence tagging tasks in natural language processing require to recognize segments with certain syntactic role or semantic meaning in a sentence. They are usually tackled with Conditional Random Fields (CRFs), which do indirect word-level modeling over word-level features and thus cannot make full use of segment-level information. Semi-Markov Conditional Random Fields (Semi-CRFs) m...
متن کاملOn the Properties of Neural Machine Translation: Encoder-Decoder Approaches
Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length representation from a variable-length input sentence, and the decoder generates a correct translation from this representation. In this paper, we focus on a...
متن کاملPolitical Ideology Detection Using Recursive Neural Networks
An individual’s words often reveal their political ideology. Existing automated techniques to identify ideology from text focus on bags of words or wordlists, ignoring syntax. Taking inspiration from recent work in sentiment analysis that successfully models the compositional aspect of language, we apply a recursive neural network (RNN) framework to the task of identifying the political positio...
متن کاملUsing Artificial Neural Network Modeling in Predicting the Amount of Methyl Violet Dye Absorption by Modified Palm Fiber
Bio-absorbent palm fiber was applied for removal of cationic violet methyl dye from water solution. For this purpose, a solid phase extraction method combined with the artificial neural network (ANN) was used for preconcentration and determination of removal level of violet methyl dye. This method is influenced by factors such as pH, the contact time, the rotation speed, and the adsorbent dosag...
متن کاملA Stacking Gated Neural Architecture for Implicit Discourse Relation Classification
Discourse parsing is considered as one of the most challenging natural language processing (NLP) tasks. Implicit discourse relation classification is the bottleneck for discourse parsing. Without the guide of explicit discourse connectives, the relation of sentence pairs are very hard to be inferred. This paper proposes a stacking neural network model to solve the classification problem in whic...
متن کامل